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APPROACH FOR PROCESSING DATA RECEIVED FROM A COMMUNICATIONS 
CHANNEL TO REDUCE NOISE POWER AND 
OPTIMIZE IMPULSE RESPONSE LENGTH TO REDUCE INTER-SYMBOL 
INTERFERENCE AND INTER-CHANNEL INTERFERENCE 

RELATED APPLICATION 

[0001] This application claims domestic priority from prior U.S. provisional application 
Ser. No. 60/264,506 (Attorney Docket No. 52637-0020), entitled "METHOD AND 
APPARATUS FOR EQUALIZATION AND NOISE MINIMIZATION IN A 
COMMUNICATIONS RECEIVER USING DISCRETE MULTTTONE MODULATION," 
filed January 25, 2001, naming as inventors A. Storm, S. Tonissen, and E. Skafidas, the 
entire disclosure of which is hereby incorporated by reference for all purposes as if fully set 
forth herein. 

FIELD OF THE INVENTION 

[0002] The present invention generally relates to digital communications systems, and 
more specifically, to an approach for processing data received from a communications 
channel to reduce noise power and optimize impulse response length to reduce inter-symbol 
interference and inter-channel interference. 

BACKGROUND OF THE INVENTION 

[0003] The approaches described in this section are approaches that could be pursued, 
but not necessarily approaches that have been previously conceived or pursued. Therefore, 
unless otherwise indicated, it should not be assumed that any of the approaches described in 
this section qualify as prior art merely by virtue of their inclusion in this section. 
[0004] There is a continuing need for higher performance digital data communications 
systems. Perhaps nowhere is this need more evident than on the worldwide packet data 
communications network now commonly referred to as the "Internet." On the Internet, the 
"richness" of content is constantly increasing, requiring an ever-increasing amount of 
bandwidth to provide Internet content to users. As a result of this increased demand for 

-1- 

Docket: 52637-0021 



Application of STORM, et al. 



bandwidth, significant efforts have been made to develop new types of high-speed digital 
data communications systems. For example, optical fiber based networks are being built in 
many large metropolitan areas and undersea to connect continents. As another example, new 
wireless protocols are being developed to provide Internet content to many different types of 
small, portable devices. 

[0005] One of the significant drawbacks of deploying many of these new types of 
high-speed digital data communications systems is the high cost and amount of time required 
to develop and build out the new infrastructure required by the systems. Because of these 
high costs, many new high-speed digital data communications systems are initially deployed 
only in densely populated areas, where the cost of building out the new infrastructure can be 
quickly recovered. Less populated areas must often wait to receive the new communications 
systems and some rural areas never receive the new systems where it is not cost effective to 
build the infrastructure. 

[0006] For several reasons, significant efforts are being made to utilize conventional 
twisted pair telephone lines to provide high-speed digital data transmission. First, a 
significant amount of twisted pair telephone line infrastructure already exists in many 
countries. Thus, using conventional twisted pair telephone lines avoids the cost of building 
expensive new infrastructure. Second, conventional twisted pair telephone lines extend into 
customers' homes and businesses, avoiding the so-called "last mile" problem. As a result of 
recent development efforts in this area, several new communications protocols, such as 
Asymmetric Digital Subscriber Line (ADSL), G.Lite and Very High Bit Rate DSL (VDSL), 
have been developed for providing high-speed digital transmission over conventional twisted 
pair telephone lines. 

[0007] Despite the advantages to using conventional twisted pair telephone lines to 
provide high-speed digital communications, there are some problems with this approach. 
First, conventional twisted pair telephone lines cause signal attenuation per unit length that 
increases rapidly with frequency. A moderate length twisted pair line, for example around 
fifteen thousand feet, may cause only a few decibels (dB) of attenuation in the voice band, 
for which the line was originally designed, but many tens of dB of attenuation at higher 
transmission frequencies, for example around 1.1 MHz for ADSL. This results in a transfer 
function with a wide dynamic range and a wide variation in group-delay, making 
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communications channel equalization more difficult. The transfer function is further 
complicated by bridge taps and impedance mismatches between line sections that cause 
reflections and echoes at the receiver. Furthermore, filtering performed at the transmitter and 
receiver also increases the complexity of the transfer function. The result is a very long 
communications channel impulse response, which creates significant inter-symbol 
interference (ISI) in a conventional digital communications receiver due to the resulting 
overlap of adjacent symbols and also may result in inter-channel interference (ICI). 
[0008] The standards for ADSL and G.Lite specify Discrete Multitone (DMT) 
modulation. DMT is also under consideration for use in VDSL systems. DMT modulation 
generally involves transmitting digital data on a number of carriers simultaneously. 
Modulation and demodulation are performed using a Fast Fourier Transform (FFT). A cyclic 
prefix is added to the data prior to transmission to ensure separation between successive 
DMT symbols and eliminate inter-symbol interference (ISI) and to help reduce inter-channel 
interference (ICI) at the receiver. In practice, the cyclic prefix is necessarily quite short, 
generally much shorter than the impulse response of the communications channel. This often 
results in significant ISI and ICI being present in the received data. Large amounts of ISI and 
ICI cause a large reduction in the available communications bandwidth. This is especially 
true for long twisted pair telephone lines likely to be encountered in ADSL and VDSL 
communications systems. The effect of this ISI is to reduce the signal to noise ratio (SNR) in 
each bin of the FFT demodulator employed in a DMT system. 

[0009] Standard equalizers used in digital communications systems, such as adaptive 
least mean square (LMS), Kalman, and recursive least squares (RLS) equalizers, are 
generally inappropriate for DMT systems since such standard equalizers are not designed to 
eliminate ISI and ICI. If the impulse response of the overall communications channel and 
equalizer is longer than the cyclic prefix, ISI and ICI can still occur. As a result, 
conventional approaches for equalizer design have the objective of shortening the overall 
communications channel plus equalizer impulse response so that the overall impulse 
response is shorter than the length of the cyclic prefix. Various attempts to reduce the overall 
impulse response to less than the length of the cyclic prefix have been made, including the 
use of finite impulse response (FIR) equalizers. See for example, Impulse Response 
Shortening for Discrete Multitone Transceivers, by P. Melsa, R. Younce, and C. Rohrs, IEEE 
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Transactions on Communications, Vol. 44 No. 12, December 1996; Optimum Finite-Length 
Equalization for Multicarrier Transceivers, by N. Al-Dhahir and J. Cioffi, IEEE 
Transactions on Communications, Vol. 44 No. 1, January 1996; and A Discrete Multitone 
Transceiver System for HDSL Applications, by J. Chow, J. Tu, and J. Cioffi, IEEE Journal on 
Selected Areas in Communications, Vol. 9 No. 6, August 1991. Determining equalizer 
coefficients is generally a computationally inefficient process and can be quite sensitive to 
noise, which limits the practical application of the techniques found in these references. 
[0010] A problem with conventional approaches that shorten the overall impulse 
response is that no consideration is given to the spectrum of noise on the communications 
channel. In particular, a common misconception of the conventional approaches is that a FIR 
equalizer leaves the signal to noise ratio (SNR) unaffected if the FIR equalizer eliminates ISI 
by shortening the impulse response. This misconception arises from an inadequate analysis 
of how demodulation by a non-windowed finite length FFT affects the noise power on the 
demodulated tones. As used herein, the term "tones" is synonymous with "frequencies." 
[001 1] The effect of the non-windowed FFT is to cause a smearing of the equalized noise 
power across the tones on the communications channel. The smearing affect can be very 
pronounced for narrow band interference sources, such as amplitude modulation (AM) radio 
signals. In addition, deep nulls in the equalize frequency response cause an attenuation of the 
signal, which is not reproduced in the noise, and as a result, even white noise at the input can 
be spread across the tones. The result of the smearing of the noise is a reduction in the SNR 
on the affected tones. Due to this reduction in the SNR, conventional approaches attempt to 
limit the range of the equalizer frequency response, but doing so in an ad hoc manner may 
result in an unacceptably large ISI. 

[0012] Based on the foregoing, there is a need for an approach for processing data 
received from a communications channel that takes into account noise while reducing 
inter-symbol interference and inter-channel interference and that does not suffer from the 
Umitations of conventional approaches. 

SUMMARY OF THE INVENTION 

[0013] Techniques are provided for processing data received from a communications 
channel to reduce noise power and optimize impulse response length to reduce inter-symbol 
interference and inter-channel interference. According to one aspect of the invention, 
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received data that is based upon both modulated data and noise is received from the 
communications channel. The modulated data is the result of original data that is modulated 
onto one or more carriers. The received data is equalized using an equalizer to generate 
equalized data. The equalizer uses an algorithm with a set of coefficients that are selected 
based on noise power and an impulse response of the communications channel. An estimate 
of the original data is recovered by demodulating the equalized data. 
[0014] According to other aspects of the invention, the coefficients are selected 
according to one or more particular approaches. For example, the coefficients may be 
selected to optimize impulse response length of the communications channel to reduce 
interference, such as inter-symbol interference (LSI) and inter-channel interference (ICI), to 
reduce noise power, or to simultaneously optimize impulse response length and reduce noise 
power, or the coefficients may be selected to minimize noise power. As another example, the 
coefficients may be selected to reduce noise power due to ISI, ICI, and noise from additional 
interference sources, including, but not limited to, crosstalk, AM radio signals, and white 
Gaussian noise. As yet another example, the coefficients may be selected by minimizing a 
function of communications channel impulse response and noise power, or based on noise 
power spectral density. 

[0015] According to yet other aspects of the invention, the received data is modulated 
using a cyclic prefix and the coefficients are selected to ensure that an impulse response of 
the communications channel and the equalizer is less than the cyclic prefix. Equalizing the 
received date includes processing the received data using a finite impulse response (FIR) 
filter, and the received data is modulated using discrete multitone modulation and a set of 
FIR coefficients selected to reduce noise power and optimize impulse response length. The 
communications channel is a twisted pair telephone line that uses a transmission protocol 
such as Asymmetric Digital Subscriber Line (ADSL), GXite or Very High Bit Rate DSL 
(VDSL). 

[0016] According to another aspect of the invention, coefficients are determined for use 
in a filter to process data received from a communications channel. A communications 
channel transfer function and a noise power spectral density are determined based on the 
received data. A communications channel impulse response is determined based on the 
communications channel transfer function, and a noise covariance is determined based on the 
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noise power spectral density. Based on the communications channel impulse response and 
the noise covariance, the coefficients for use in the filter are determined. 
[0017] According to other aspects of the invention, a computer-readable medium, a 
carrier wave, an apparatus, and a system are configured to carry out the foregoing functions. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0018] The present invention is depicted by way of example, and not by way of 
limitation, in the figures of the accompanying drawings and in which like reference numerals 
refer to similar elements and in which: 

[0019] FIG. 1 is a block diagram of a conventional digital data communications 
arrangement; 

[0020] FIG. 2 is a block diagram of an arrangement for processing data received from a 

communications channel, according to an embodiment of the invention; 

[0021] FIG. 3 is a flow diagram that depicts an approach for processing data received 

from a communications channel, according to an embodiment of the invention; 

[0022] FIG. 4 is a flow diagram of an overview of FIR filter coefficient estimation, 

according to an embodiment of the invention; and 

[0023] FIG. 5 is a block diagram of a computer system on which embodiments of the 
invention may be implemented. 

DETAILED DESCRIPTION OF THE INVENTION 

[0024] An approach for processing data received from a communications channel to 
reduce noise power and optimize impulse response length to reduce inter-symbol interference 
and inter-channel interference is described, hi the following description, for the purposes of 
explanation, numerous specific details are set forth in order to provide a thorough 
understanding of the present invention. It will be apparent, however, to one skilled in the art 
that the present invention may be practiced without these specific details. In other instances, 
well-known structures and devices are depicted in block diagram form in order to avoid 
unnecessarily obscuring the present invention. 

[0025] In the following description, the various functions shall be discussed under topic 
headings that appear in the following order: 
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L OVERVIEW 

A. Communications System Arrangement 

B. Receiver 

C. Communications Processing 

D. Discrete Multitone Modulation 
IT. FIR FILTERING 

HI. THEORETICAL BACKGROUND FOR FIR FILTER COEFFICIENT 
ESTIMATION 

IV. FIR FILTER COEFFICIENT ESTIMATION 

A. Overview of FIR Filter Coefficient Estimation Approach 

B . Detailed Description of FIR Filter Coefficient Estimation 

V. IMPLEMENTATION MECHANISMS 

VI. EXTENSIONS AND ALTERNATIVES 

L OVERVIEW 

[0026] An approach for processing data received from a communications channel to 
reduce noise power and optimize impulse response length to reduce inter-symbol interference 
and inter-channel interference generally involves minimizing a function of both the impulse 
response and the total noise from all sources of interference. A procedure is then derived for 
obtaining the coefficients of the equalizer, which enables the number of bits per symbol to be 
optimized. According to one embodiment of the invention, the equalizer coefficients are 
determined based on both reducing the communications channel noise due to all sources and 
on the distortion that results from the failure of the equalizer coefficients to completely 
eliminate ISL It has been observed that using the so-called "optimal shortening filters," the 
ISI may be almost entirely eliminated. However, the equalizer can have a frequency 
response with a wide dynamic range resulting in SNR degradation due to smearing of the 
noise across tones. According to one embodiment of the invention, this degradation is 
eliminated, minimized, or at least reduced by taking into account the equalized noise power. 
The result is a superior equalizer for use in communications receivers employing orthogonal 
frequency division multiplexing or discrete multitone modulation. 
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[0027] As used herein, the term "noise" is broadly defined to refer to any error in a 
received signal as compared to the original transmitted signal. In the following discussion, 
the term "noise" includes all sources of noise, including ISI, ICI, and external sources of 
interference, such as AM radio signals and crosstalk resulting from interference from 
adjacent physical channels. Also, noise includes other interference sources, such as white 
Gaussian noise and distortion introduced by the receiver. While ISI is a source of noise that 
results from successive symbols interfering with each other because the impulse response is 
too long, ISI is referred to separately herein since ISI is a particular source of noise of interest 
herein. Similarly, while ICI is a source of noise that arises from adjacent tones interfering 
with each other on a signal or as an indirect result of the impulse response not being 
sufficiently short, ICI is referred to separately herein since ICI is a particular source of noise 
of interest herein. 

[0028] The approach described herein addresses both (1) the problem of shortening the 
impulse response to reduce ISI and ICI and (2) reducing the total noise power at the output of 
the equalizer by using an optimization criteria for the HR coefficients that jointly (a) 
optimizes the impulse response length and (b) reduces the noise power at the output of the 
equalizer. Thus, by taking into account the actual noise conditions of the communications 
channel, the noise power is reduced while the impulse response is optimized. 

A. Communications System Arrangement 

[0029] FIG. 1 is a block diagram of a conventional communications system 
arrangement 100. Arrangement 100 includes a transmitter 102 communicatively coupled to a 
receiver 104 via a communications channel 106. Communications channel 106 may be any 
type of medium or mechanism for providing data from transmitter 102 to receiver 104. For 
purposes of explanation only, various embodiments of the invention are described herein in 
the context of communications channel 106 as a landline, such as one or more conventional 
twisted pair telephone lines. 

[0030] Transmitter 102 receives digital source data 108, e.g., a digital data stream, that is 
modulated by a modulator 1 10 to generate a sampled data signal s(n), where n is the sample 
number, and the sampling rate is given by F s . The sampled data signal s(n) is converted to an 
analog signal s(t) by a digital to analog converter 112. The analog signal s(t) is processed by 
a transmit filter 1 14 to remove unwanted components from the analog signal s(r). The analog 
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signal s(t) is then amplified by a line driver 1 16 and transmitted onto communications 
channel 106. 

[0031] It should be noted that the transmitted analog signal s(t) is not strictly a 
continuous time representation of the sampled data signal s(n) since transmit filter 1 14 
modifies the signal, but is represented as such herein for the purposes of explanation. 
[0032] The transmitted analog signal s(t) passes through communications channel 1 06, 
which has an impulse response of h(t) and corresponding transfer function H(f). The output 
of communications channel 106 x(r) is the convolution of the transmitted analog signal s(t) 
and the communications channel impulse response h(t), given by: 

[0033] x(t) = s(t)*h(t) (1) 

[0034] The signal received by receiver 1 04 y (?) is the sum of the output of 
communications channel 106 x(t) and an additive noise signal w(t), given by: 

[°035] y(t) = x(t) + w(t) (2) 

[0036] where the additive noise signal w(t) consists of any form of interference 
introduced by communications channel 106, for example crosstalk or AM radio signals, and 
an additive white Gaussian noise component. 

[0037] A differential amplifier 1 1 8 processes the received signal y(t) to generate an 
amplified signal y(t). The amplified signal y{i) is then processed by one or more receive 
filters 120 to remove undesired components and generate a filtered signal y(t). The filtered 
signal y(t) is sampled by analog-to-digital converter 122 to generate a digital signal y(n) that 
at this point is still modulated. It should be pointed out that y(n) is not strictly a sampled 
version of y(t) due to the processing of receive filters 120 which modify the signal, but is 
represented as such herein for the purposes of explanation. 

[0038] An equalizer 1 24 processes digital signal y(n) in the time domain to remove ISI 
and recover the transmitted modulated data z(n). While z(n) is not strictly the transmitted 
modulated data, but rather an equalized version of the received signal, z(n) is represented as 
such herein for purposes of explanation. A demodulator 126 processes the modulated data 
z(n) to generate recovered source data 128. For example, in a DMT system, demodulator 126 
processes equalized data z(n), such as by using an FFT and a frequency domain equalizer 
(FDEQ), with the output of demodulator 126 closely approximating the source data 108. 
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[0039] For example, a time domain equalizer may be used to compensate for the 
communications channel in such a way as to maximize the signal to noise ratio (SNR) at the 
output of the demodulator. The optimal equalizer design depends on the nature of the 
modulation. For example, for a standard single carrier modulation such as quadrature 
amplitude modulation (QAM), the optimal equalizer minimizes the mean square error at the 
equalizer output, thereby maximizing the broadband SNR. 

B. Receiver 

[0040] FIG. 2 is a block diagram of a receiver 200 for processing received data y(t) 202 
from communications channel 106, according to an embodiment of the invention. As with 
the conventional arrangement 100 of FIG. 1, received data y(t) 202, obtained from 
communications channel 106, is the sum of the output of communications channel 106 x(t) 
and an additive noise signal w(t). The received data y(t) 202 is processed by a differential 
amplifier 204, one or more receive filters 206 and an analog-to-digital converter 208 to 
produce a sampled signal y{n), where n is the sample number. 

[0041] The sampled signal y(n) is provided to an equalizer 210 that produces an estimate 
z(ri) of the sampled communications channel 106 input signal that is provided to a 
demodulator 216. Demodulator 216 recovers an estimate of the original source data 108 in 
the form of recovered source data 218. For example, in a DMT system, demodulator 126 
processes equalized data z(n), such as by using an FFT and a FDEQ, with the output of 
demodulator 126 closely approximating the source data 108. In general, demodulator 216 
may perform several functions that may be performed by distinct entities, such as a time 
domain to frequency domain converter, a FDEQ for correcting any residual amplitude and 
phase distortion, and a constellation decoder. 

[0042] According to one embodiment of the invention, equalizer 2 1 0 includes a finite 
impulse response (FIR) filter 212 and an FIR coefficient estimator 214. FIR filter 212 
processes the sampled signal y(n) to produce the estimate z(n) of the sampled 
communications channel 106 input signal. FIR coefficient estimator 214 determines the 
coefficients required by FIR filter 212. According to one embodiment of the invention, the 
coefficients for FIR filter 212 are selected such that distortion due to inter-symbol 
interference and demodulated noise power is reduced. 
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C. Communications Processing 

[0043] FIG. 3 is a flow diagram 300 that depicts an approach for processing data 
received from a communications channel, according to an embodiment of the invention. 
After starting in step 302, in step 304, received data y(t) is received from communications 
channel 106. In step 306, the received data y(t) is processed by differential amplifier 204 to 
generate amplified data y(t). In step 308, the amplified data is processed by the one or more 
receive filters 206 to generate filtered datay(r). 

[0044] In step 310, the filtered data y(t) is sampled by analog-to-digital converter 208 to 
generate a sampled signal y(n). In step 312, the sampled signal y(n) is processed by FIR 
filter 212, which generates an estimate z(n) of the sampled communications channel 106 
input signal. In step 314, the estimate z(n) of the sampled communications channel 106 input 
signal is provided to a demodulator 216 that recovers an estimate of the original source 
data 108 in the form of recovered source data 218. For example, in a DMT system, 
demodulator 126 processes equalized data z(n), such as by using an FFT and a FDEQ, with 
the output of demodulator 126 closely approximating the source data 108. The process is 
complete in step 316. 

D. Discrete Multitone Modulation 

[0045] According to one embodiment of the invention, the techniques described herein 
are related to time domain equalization for a DMT modulation system. In such a system, the 
focus is on the SNR in each narrow band associated with an individual carrier, not the 
broadband SNR across the entire communications channel bandwidth. 
[0046] hi DMT, the sample data signal s(n) is created from a sequence of symbols ( s t )i>p 
as follows. Each symbol s t consists of a vector of length N of complex numbers: 

[0048] where s !k is an element of a constellation of 2 bk points. From si,aM = 2N point 
vector di is created having Hermitian symmetry. That is, dm and dm are real numbers, and 
diM-k = dm * for 1 < k < N - 1 . The vector di is modulated by an inverse FFT to create: 

[0049 J %=-y^expf^\ (4 ) 

M to { M W 
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[0050] The sequence (x ir )r is periodic in r with period M, so that x t ,. r = x m . r . The signal 
s(n) is created from the sequence ( x t ) & by passing the M+ c element vectors: 



[0051] 




[0052] through a parallel to serial converter. Since the first c elements of Equation (5) 
are equal to the last c, the effect is to create a prefix of length c equal to the last c symbols. 
This is known as a cyclic prefix. Formally, the relation between s(n) and ( xi)i> 0 is given by: 



[0054] The cyclic prefix is effective in eliminating ISI and ICI provided the sampled 
communications channel impulse response h(n) is shorter than the length of the cyclic prefix. 
Unfortunately, the nature of the communications channel, coupled with any transmit and 
receive filtering, will ensure that the impulse response is likely to be significantly longer than 
the cyclic prefix. This is especially true for long twisted pair telephone lines likely to be 
encountered in ADSL and VDSL communications systems. The effect of this ISI and ICI is 
to reduce the SNR in each bin of the FFT demodulator employed in a DMT system. 
[0055] hi order to prevent the ISI and ICI caused by a long communications channel 
impulse response, it is necessary to implement a time domain equalizer. The coefficients of 
this time domain equalizer should be chosen to ensure the overall response of the 
communications channel and equalizer is less than the length of the cyclic prefix. However, 
while reducing of ISI and ICI is an important concern, it is not the only issue of importance. 
As discussed below, SNR degradation due to the combined effects of noise, ISI, and ICI is 
also of concern. 

[0056] Several attempts have been made to develop equalizers that reduce the length of 
the overall communications channel plus equalizer impulse response. For example, in 
A Discrete Multitone Transceiver System for HDSL Applications, by J. Chow, J. Tu, and 
J. Cioffi, IEEE Journal on Selected Areas in Communications, Vol. 9 No. 6, August 1991, 
(hereinafter "Chow") the approach is to identify an autoregressive-moving average (ARMA) 
model for the communications channel, and use the identified AR parameters as the 
equalizer. The procedure in Chow suggests canceling the communications channel 
denominator, but exact cancellation is never possible. Further, modeling the transfer 



[0053] 



s(n + l(M + c)) = xi, n -c,0<n<M+c- 1 . 



(6) 
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function by a rational function and canceling the modeled denominator as in Chow is a very 
ad hoc procedure that does not take into account the effect of the equalizer on the noise. 
[0057] As another example, in Impulse Response Shortening for Discrete Multitone 
Transceivers, by P. Melsa, R. Younce, and C. Rohrs, IEEE Transactions on 
Communications, Vol. 44 No. 12, December 1996, (hereinafter "Melsa") the procedure is to 
apply an eigenvector decomposition method to determine the optimal shortening filter 
subject to a finite energy constraint. Melsa claims that this gives superior performance to the 
ARMA communications channel identification method, but Melsa gives no consideration to 
the effect the equalizer has on the noise. Furthermore, the approach of Melsa for determining 
the equalizer coefficients is computationally expensive and can be sensitive to errors. 
[0058] As yet another example, in Optimum Finite-Length Equalization for Multicarrier 
Transceivers, by N. Al-Dhahir and J. Cioffi, IEEE Transactions on Communications, Vol. 44 
No. 1, January 1996, (hereinafter "Dhahir"), the optimization is performed based on 
maximizing the number of bits per DMT symbol, which is achieved by maximizing a term 
referred to as SNR geom , the product of the individual signal to noise ratios for each tone. 
Unfortunately, the expression used in Dhahir for SNR geom is a constant for any linear 
equalizer and does not take into account the residual ISI. Furthermore, the approach of 
Dhahir for determining the equalizer coefficients is computationally expensive and can be 
sensitive to errors. 

H. FIR FILTERING 

[0059] As previously described herein, equalization is performed using FIR filter 212. 
The number of taps p+l in FIR filter 212 is generally chosen based upon the requirements of 
a particular application. According to one embodiment of the invention, at least sixteen taps 
are used to ensure adequate equalizer results, particularly for longer loops. The samples of 
the input signal to FIR filter 212 are denoted by y{n), where n is the sample number. FIR 
filter 212 filters the sampled signal y(n) to form the filtered signal z(n) provided to 
demodulator 216, such that: 

[0060] z{n) = ^)y(n-i) (7) 
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[0061] where {(p(i),i = 0,...p} is the set of FIR filter coefficients. The FIR filter 
described by Equation (7) is the standard form of an FIR filter. 

IE. THEORETICAL BACKGROUND FOR FIR FILTER COEFFICIENT 

ESTIMATION 

[0062] FIR filter coefficient estimator 214 estimates the set of FIR coefficients, denoted 
by [<p(i),i = 0,...p] for use in FIR filter 212. Using the approach described herein in this 
application, the coefficients are determined such that the total noise plus ISI and ICI power is 
reduced, and in some instances minimized, for the given communications channel conditions. 
This is achieved by determining coefficients that reduce the distortion due to ISI and ICI plus 
the demodulated noise power. 

[0063] After being filtered by the equalizer, the signal is passed through a serial to 
parallel converter, discarding the first c samples from each block of length M + c, possibly 
with a delay or timing offset 9 , to create a sequence of vectors ( z m ) m >p, each of length M. 
Formally, the relation between z(n) and ( z m )m>p is given by: 

[0064] Zmt = z(9 + c + t + m(M +c)), 0<t<M-l . (8) 

[0065] Each vector Zm is demodulated by an FFT to create a sequence ( Zm ) m >o, of 
demodulated symbols. The relationship between z m and Zm is: 

[° 066 1 Z^S^expp^l (9) 

to V M ) 

[0067] If the sequence ( di )&) is uncorrected, it may be shown that the demodulated 
symbol Zm is related to the transmitted symbol d m by: 

[° 068 ] Z mk =F k d nA +V mk (10) 

[0069] where V mk is a term representing the combined effects of noise and inter-symbol 
interference, 



[0070] F * = X 8(n)a(n-9)exp 

n=-M+l \ 



2mk{n-9 



M 



Docket: 52637-0021 



-14- 



Application of STORM, et al. 



[0071] 



g(n) = ^(p(k)h(n-k) 



(12) 



[0072] is the equalized communications channel impulse response and a(n J is a window 
function related to the cyclic prefix by: 



[0073] 



a(n) = 



\-{n-c)IM\c<n<M + c 
l;0<n<c 

l + n/M;-M <n<0 



(13) 



[0074] Also, one may show that: 



[0075] 



M-l / ^ \ 1* 2 27T 

S^| 2 )=|->H 2 r(^ 

fc=0 777 



27T 



(14) 



[0076] where: 
[0077] 



<E>(«) =2 f ?>(A:)expHGJfe) 



(15) 



[0078] is the equalizer frequency response, r(a)) is the noise power spectral density, o(n) 
is related to the transmitted power on each tone by: 



[0079] 

[0080] with 
[0081] 



, , 1 (2jeWO 



(16) 



**=4u 2 )> 

[0082] the function /(x j) is given by: 



(17) 



[0083] 



n - x 



M + c 



n - y 



M + c 



(18) 



[0084] for any integers x and y, and I(condition) is equal to 1 if the condition is true 
and 0 otherwise. The expression given for: 
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M-l ( \ 

[0085] ) (19) 

k=Q 

[0086] is a quadratic function of the equalizer coefficients. If cp'= (p(0), <p(l), . . . ,q>(p)) 
is the vector of equalizer coefficients and y(n) is the noise covariance, then: 



[0087] 



M-l / \ 

ZE\V mk \ 2 )=<p'N<p + <p'G(p (20) 

i=0 



[0088] where: 

[0089] N u =M 2 y(k-l) (21) 

[0090] and 

[0091] G H = 2 ^h(n-k)h(m-k)a(m-n)(J(n-d,m-6)-Ma(n-e)a(m-d) (22) 



[0092] Normally the expression for the ISI and ICI power is difficult to work out, but a 
particularly simple special case occurs when S k = S\/k , in which case: 

[0093] a(n) = SI(n = 0mod(M)) . (23) 

[0094] Also, it is usually safe to assume that the equalized impulse response is zero for n 
outside the range 0 to M - 1 . ]h this case the ISI and ICI power reduces to: 



M-l 

[0095] SM^g(n) 2 (l-a(n-6) 2 ) , (24) 

[0096] which gives: 

[0097] G u =SM y £ h(n - k)h(n - /)(! -a{n-d) 2 ). (25) 



M-l 



n-0 



IV. FIR FILTER COEFFICIENT ESTIMATION 

A. Overview of FIR Filter Coefficient Estimation 

[0098] FIG. 4 is a flow diagram 400 of an overview of FIR filter coefficient estimation, 
according to an embodiment of the invention. After starting in step 402, the communications 

-16- 

Docket: 52637-0021 



Application of STORM, et al 

channel transfer function is estimated in step 406. For example, in ADSL, a CJREVERB 
training sequence can be used to accumulate symbols over a given period to obtain an 
averaged received symbol, which taken with the known transmitted signal during the same 
period, provides an estimate of the communications channel frequency response, (e.g., the 
communications channel transfer function). 

[0099] In step 408, the noise power spectral density is estimated. For example, in ADSL, 
the same part of the training sequence as in step 406 or another part of the training sequence 
can be used to measure received symbols at the output of the FFT. The average symbol is 
subtracted to remove the transmitted signal portion of the signal. 

[0100] In step 410, the communications channel impulse response is estimated based on 
the communications channel transfer function. For example, an inverse FFT of the 
communications channel transfer function can be used to estimate the communications 
channel impulse response. 

[0101] hi step 412, the noise covariance is estimated based on the noise power spectral 
density. For example, an inverse FFT of the noise power spectral density can be used to 
estimate the noise covariance. 

[0102] hi step 414, the equalizer coefficients are determined based on the 
communications channel impulse response and the noise covariance. For example, two 
matrices can be formed based on the communications channel impulse response and the 
noise covariance. The matrix corresponding to the communications channel impulse 
response can include a window function related to the length of the cyclic prefix. A 
quadratic expression using the two matrices can be minimized based on an appropriate 
constraint on the equalizer to determine the equalizer coefficients. The filter coefficients thus 
determined can be rescaled, if desired. 
[0103] The process is complete in step 416. 

B . Detailed Description of FIR Filter Coefficient Estimation 

[0104] According to one embodiment of the invention, the FIR filter coefficients used by 
FIR filter 212 are determined as follows: 

[0105] (a) Estimate the communications channel frequency response H k in each tone 
(e.g., step 406). Such an estimation can be carried out during part of an 
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initialization and training sequence, where a known symbol sequence is 
transmitted on a repeated basis. H k may be estimated as follows: 
[0106] (i) Let: 

[0107] ( dk )S (26) 

[0108] be the repeatedly transmitted Hermitian symmetrised symbol block 

(prior to modulation). In an ADSL system, one of the CLREVERB 
sequences can be used to estimate the downstream communications 
channel transfer function. 
[0109] (ii) Let y n , n = 0, . . . , L be the sequence of received signal blocks, prior to 

demodulation. Each block y n is a vector of length M, consisting of the M 
received samples corresponding to the n th transmitted training symbol, 
and L is the total number of training symbols on which the transfer 
function is to be estimated. The demodulated signal corresponding to 
this block is given by: 

[OHO] Y n = FFT(y n ) (27) 

[0111] that is, 

C° 112 ] I* = X y« ex P — TT \ (28) 

[0113] (iii) Discard Y 0 to avoid end effects and calculate the average received 

symbol as: 

[0H4] Y=j2Y n (29) 

L n=l 

[0115] This may be computed via appropriate recursive formulae to avoid 

overflow problems. 

[0116] (iv) The estimate of the communications channel transfer function is 

computed by the formula: 

[0H7] H k J-± (30) 

[0118] for \<k<N-l and iV + 1 < k < M -1 , with: 

[0H9] H 0 =H N =0 (31) 
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[0120] since no data is transmitted at DC or Nyquist frequency. An alternative 

approximation is to interpolate values for H 0 and H N from the adjacent 

values of the transfer function to avoid discontinuities. 
[0121] (b) Estimate the noise power spectral density (e.g., step 408). 
[0122] (i) Apply a suitable window function k(s\ 0<s<M - 1 to each received 

symbol prior to demodulation to obtain: 
[0123] y m = y m K(s) , (32) 

[0124] (ii) then demodulate as before to obtain: 

M ' l „ ( 2nks\ 

s=0 



[0125] 
[0126] 



M 



(33) 



(iii) Estimate the noise power spectral density at frequency Ink I M from the 
sample variance of as follows: 



[0127] 

[0128] 
[0129] 
[0130] 
[0131] 



where: 



M-l 



5=0 



and: 



L> m=1 



(34) 



(35) 



(36) 



[0132] (c) Estimate the communications channel impulse response based on the 
communications channel transfer function (e.g., step 410). The 
communications channel impulse response is computed as the inverse FFT 

of H: 



[0133] 



Xtf*exp— — ■ 



(37) 



[0134] (d) Estimate the noise covariance based on the noise spectral power density 

(e.g., step 412). The noise covariance is computed as the inverse FFT of f : 



[0135] 



7(0 = — YJk ex P 



(38) 
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[0142] MN + SG = 



[0136] (e) Determine the equalizer coefficients based on the communications channel 

impulse response and noise covariance (e.g., step 414). 
[0137] (i) From the estimates h(t) and f(t) , construct the (p + 1) x (p + 1) 

matrices N and G having elements: 
[0138] N H =f(k-l) (39) 

[0139] and 

[0140] G u = %h(n - Win - 1)(1 - a(n - 9? ) . (40) 

[0141] (ii) The optimal set of equalize coefficients is obtained by minimizing the 

quadratic (p\MN + SG)(p , but some constraint on (p is required, 
otherwise the minimum is obtained at <p = 0 . A numerically simple 
constraint, which gives good results, is obtained by setting <p(0) = 1 . If 
one writes <p' = (1, CO and partitions the matrix MN + SG as: 

r n (4D 
u p. 

[0143] where R is a scalar, /is p x 1 , and F is p x p, then the quadratic form 

Q = <p'{MN + SG)(p becomes: 
[0144] Q = R + 2f% + CH. (42) 

[0145] (iii) Equation (42) is minimized by setting £ to be the solution to the set of 

linear equations: 

[0146] F£ = -f. (43) 

[0147] (iv) The optimal set of FIR filter coefficients is then obtained as: 

[0148] <p= ■ 

V s ) 

[0149] (v) If desired, the filter coefficients may be re-scaled as required, as 
re-scaling does not affect the signal to noise ratio. 

[0150] (vi) hi practice, one must also determine a value for the timing offset or 

delay, 0 . Since the quadratic Q{0) = <p\MN + SG(0))(p measures the 
noise plus ISI power once q> has been computed, a useful criterion for 



(44) 
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choosing 0 is to minimize Q(0 ). This minimization problem does not 
admit an analytical solution, so the optimum value may be found by 
searching over a given range using a one dimensional search technique 
such as a Fibonacci search. 

V. IMPLEMENTATION MECHANISMS 

[0151] The approach for processing data received from a communications channel to 
reduce noise power and optimize impulse response length to reduce inter-symbol interference 
described herein may be implemented in a variety of ways and the invention is not limited to 
any particular implementation. The approach may be integrated into any communications 
system or a receiver device, or may be implemented as a stand-alone mechanism. 
Furthermore, the approach may be implemented in computer software, hardware, or a 
combination thereof. 

[0152] FIG. 5 is a block diagram that depicts a computer system 500 upon which an 
embodiment of the invention may be implemented. Computer system 500 includes a bus 502 
or other communications mechanism for communicating information, and a processor 504 
coupled with bus 502 for processing information. Computer system 500 also includes a main 
memory 506, such as a random access memory (RAM) or other dynamic storage device, 
coupled to bus 502 for storing information and instructions to be executed by processor 504. 
Main memory 506 also may be used for storing temporary variables or other intermediate 
information during execution of instructions to be executed by processor 504. Computer 
system 500 further includes a read only memory (ROM) 508 or other static storage device 
coupled to bus 502 for storing static information and instructions for processor 504. A 
storage device 510, such as a magnetic disk or optical disk, is provided and coupled to bus 
502 for storing information and instructions. 

[0153] Computer system 500 may be coupled via bus 502 to a display 512, such as a 
cathode ray tube (CRT), for displaying information to a computer user. An input device 514, 
including alphanumeric and other keys, is coupled to bus 502 for communicating information 
and command selections to processor 504. Another type of user input device is cursor 
control 516, such as a mouse, a trackball, or cursor direction keys for communicating 
direction information and command selections to processor 504 and for controlling cursor 
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movement on display 512. This input device typically has two degrees of freedom in two 
axes, a first axis (e.g., x) and a second axis (e.g., y), that allows the device to specify 
positions in a plane. 

[0154] The invention is related to the use of computer system 500 for implementing the 
techniques described herein. According to one embodiment of the invention, those 
techniques are performed by computer system 500 in response to processor 504 executing 
one or more sequences of one or more instructions contained in main memory 506. Such 
instructions may be read into main memory 506 from another computer-readable medium, 
such as storage device 510. Execution of the sequences of instructions contained in main 
memory 506 causes processor 504 to perform the process steps described herein. In 
alternative embodiments, hard-wired circuitry may be used in place of or in combination with 
software instructions to implement the invention. Thus, embodiments of the invention are 
not limited to any specific combination of hardware circuitry and software. 
[0155] The term "computer-readable medium" as used herein refers to any medium that 
participates in providing instructions to processor 504 for execution. Such a medium may 
take many forms, including but not limited to, non-volatile media, volatile media, and 
transmission media. Non-volatile media includes, for example, optical or magnetic disks, 
such as storage device 510. Volatile media includes dynamic memory, such as main memory 
506. Transmission media includes coaxial cables, copper wire and fiber optics, including the 
wires that comprise bus 502. Transmission media can also take the form of acoustic or light 
waves, such as those generated during radio-wave and infra-red data communications. 
[0156] Common forms of computer-readable media include, for example, a floppy disk, a 
flexible disk, hard disk, magnetic tape, or any other magnetic medium, a CD-ROM, any other 
optical medium, punchcards, papertape, any other physical medium with patterns of holes, a 
RAM, a PROM, and EPROM, a FLASH-EPROM, any other memory chip or cartridge, a 
carrier wave as described hereinafter, or any other medium from which a computer can read. 
[0157] Various forms of computer readable media may be involved in carrying one or 
more sequences of one or more instructions to processor 504 for execution. For example, the 
instructions may initially be carried on a magnetic disk of a remote computer. The remote 
computer can load the instructions into its dynamic memory and send the instructions over a 
telephone line using a modem. A modem local to computer system 500 can receive the data 
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on the telephone line and use an infra-red transmitter to convert the data to an infra-red 
signal. An infra-red detector can receive the data carried in the infra-red signal and 
appropriate circuitry can place the data on bus 502. Bus 502 carries the data to main memory 
506, from which processor 504 retrieves and executes the instructions. The instructions 
received by main memory 506 may optionally be stored on storage device 510 either before 
or after execution by processor 504. 

[0158] Computer system 500 also includes a communications interface 5 1 8 coupled to 
bus 502. Communication interface 518 provides a two-way data communication coupling to 
a network link 520 that is connected to a local network 522. For example, communication 
interface 518 may be an integrated services digital network (ISDN) card or a modem to 
provide a data communication connection to a corresponding type of telephone line. As 
another example, communication interface 518 may be a local area network (LAN) card to 
provide a data communication connection to a compatible LAN. Wireless links may also be 
implemented. In any such implementation, communication interface 518 sends and receives 
electrical, electromagnetic or optical signals that carry digital data streams representing 
various types of information. 

[0159] Network link 520 typically provides data communication through one or more 
networks to other data devices. For example, network link 520 may provide a connection 
through local network 522 to a host computer 524 or to data equipment operated by an 
Internet Service Provider (ISP) 526. ISP 526 in turn provides data communication services 
through the world wide packet data communication network now commonly referred to as 
the "Internet" 528. Local network 522 and Internet 528 both use electrical, electromagnetic 
or optical signals that carry digital data streams. The signals through the various networks 
and the signals on network link 520 and through communication interface 518, which carry 
the digital data to and from computer system 500, are exemplary forms of carrier waves 
transporting the information. 

[0160] Computer system 500 can send messages and receive data, including program 
code, through the network(s), network link 520 and communication interface 518. In the 
Internet example, a server 530 might transmit a requested code for an application program 
through Internet 528, ISP 526, local network 522 and communication interface 518. 
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[0161] The received code may be executed by processor 504 as it is received, and/or 
stored in storage device 510, or other non-volatile storage for later execution, In this manner, 
computer system 500 may obtain application code in the form of a carrier wave. 

VI. EXTENSIONS AND ALTERNATIVES 

[0162] In the foregoing specification, the invention has been described with reference to 
specific embodiments thereof. It will, however, be evident that various modifications and 
changes may be made thereto without departing from the broader spirit and scope of the 
invention. For example, while the techniques described herein are often described in the 
context of DMT systems, the techniques herein are equally applicable to an orthogonal 
frequency division multiplexing (OFDM) system. As another example, a FIR coefficient 
generator that is configured to perform the techniques described herein may be used. 
Therefore, the specification and drawings are, accordingly, to be regarded in an illustrative 
rather than a restrictive sense. The invention includes other contexts and applications in 
which the mechanisms and processes described herein are available to other mechanisms, 
methods, programs, and processes. 

[0163] In addition, in this disclosure, certain process steps are set forth in a particular 
order, and alphabetic and alphanumeric labels are used to identify certain steps. Unless 
specifically stated in the disclosure, embodiments of the invention are not limited to any 
particular order of carrying out such steps. In particular, the labels are used merely for 
convenient identification of steps, and are not intended to imply, specify or require a 
particular order of carrying out such steps. 
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